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Ml ri TIMEDIA TFRMirslAl ADA PTFn FOR MULTIPLE USERS 



The present invention relates to a terminal for processing digital audio-visual or multimedia data. 

Temiinals of this kind are well-known in the field of pay TV systems, where a decoder or set-top-box 
receives broadcast digital multimedia data, including audiovisual program infom^ation. as well as data 
for generating on-screen menus, data for implementing gaming or shopping applications etc. 
Depending on the system, the data may be broadcast in scrambled or clear f omn. 

Prior to the introduction of digital technology, decoders were connected to a limited number of devices, 
usually only an associated television display or. at maximum, a television display and a VHS recorder. 
The advent of digital technology has led to an explosion in the number of devices that may be 
connected to the decoder as well as the functionalities of the decoder. For example, in addition to a 
Peritel analogue output to a TV and VHS device, the decoder may also include a connection via a 
digitarbus.TO-™ iEEE 1394 bus. to o^^^^^^^^ such as a DVD recorder, a PG etc. 

AS a complement to the increase in the number of external devices that may be connected to the 
decoder, there has been an increase in the number of modes of operation of a device. For example, 
in the standard set up of decoder and television, the decoder may be used erther to simply supply 
television broadcast information, or to provide a connection to the internet. 

,n evolving away from the traditional analogue system, the architecture of presently known digital 
decoders has nevertheless tended to follow the preconceptions guiding their design. In particular, the 
architecture of standard decoders does not accurately reflect the role of a terminal in routing data 
between many external devices in parallel, the modes of operation of the decoder and the number of 
users of the system that may exist. 

According to the present invention, there is provided a temiinal for processing digital audio-visual or 
multimedia data including a data processing system and a memory, characterised in that the data 
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processing system stores in the memory user profile data relating to the characteristics or preferences 

of a plurality of types of user of the terminal. 



The definition of a user profile enables the processing system to flexibly treat and handle a number of 
5 users of the temninal. As will be appreciated, whilst a user profile may be associated with the 

connection of an external device or the personal identity of the operator accessing the terminal it is 
preferably associated with a mode of operation, for example, internet mode or television mode. 

A user profile may also further be personalised for one or more operators. For example, after defining 
1 0 a user profile for the internet mode of operation of the terminal, it may be possible to define a first 
internet operator having certain rights and a second operator having other rights. 

Advantageously, the user profile data includes resource data indicating the resources within the 
tenninal accessible by each user. In the case of a decoder temilnal. these resources may include 
rights of access to the demuHiplexer to detemnine the data.downloadedJrom the.broadcast data. . 
stream etc. 



15 



Further advantageously, the user profile data includes priority data indicating the priority of each user 
in respect of access to one or more resources of the temilnal. For example, for a decoder temilnal. 
20 the user profile data may Include a priority level indicating the priority of a particular user in accessing 
the demultiplexer. Conflicting channel demands between, for example, a TV device user and a 
recorder device user can thereafter be resolved by a management application based on this 
information, 

25 in addition to resource data indicating the terminal resources available to a given device, the user 
profile data may further comprise data relating to the attributes of InfonTiation to be supplied to each 
user. These attributes may include, for example, an indication of the language to be used in all 
graphical interface displays for that user. 
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,„ ad«on. ,h. user p,o,«e ...a may .u«h« .*de dau ,e,a«n, .o .he aCons pe:mi«ed b, each 

.a resource .a.a described above, mis da,a ™, be used .o define ,be para™.ers o, .be opera.,o™ 
permined by each device having access to a given resource. 

Preierab,, some o, a„ o, ,he charac.eris,ics or pre— o, ,he user pro.,.e da.a may be modil^d 

aach user . accessing da.a may be modi,ied by a viewer .o give a VMS recorder ou,pu, pdor,.y over a 
.aie^sion ou.pu.. or an imeme. conneCion phoriry over « .eiev^ioo e.c. ,„ add,..n. or ai,ema«ve,y. 
.o.e or a« o. ,he user profile da« may be prade.ermined by me da.a processing system o, me 

terminal. 

The present invention is padicuiariy adaptable to a termina, comprising a data processing system 
comprising. In.er alia, a virtual machine and an ob,ec. oriented application i^edace iayer comp^^g a 

plurality ot Class libraries. 

,n pan^u^r. me application ^tedace iayer ma, comprise one or more class librades detinlng me 
„parationo,mevir.ualmachinew*respeottoMserpro.,ieda,a. These classes may include, tor 
axam^e a c^s library ded^ated to management o, user protile da« m ,he memory cache o, me 
,am,lnal. E,ually, me classes may include one or more user profile c^s libraries .o detlne .be 
cbaracten^t^ o. me data to be s.»ed . me user protiles: For examp.. a method class may be used 
,0 define the a«dbutes o. me preferred language .o be stored In .he user profile. 

' The behaviour of classes wKhin me appUcaticn intertace layer w,« depend on the language chosen, in 
tne case ^ an application intedac. wr«en in .ava. for example, a single inheritance strt^ture may 
apply betvreen a class and Us subclasses. 

. ,„ one embodlmen,. .he user profiie classes may include a geneHc class libraiV associated wim .he 
defin»ion of generic characteristics of user profile data, and one or more sub-class iibrades assoc^ted 
^ me definitions of charao.eris.ics associated v*h a specific user profile. 
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The present invention is particularly applicable to a terminal in the form of a decoder adapted to 
receive data transmissions in a digital transmission system. 

5 The present invention may equally extend to a method of operation of a terminal. 

The term "decoder" may describe a receiver for receiving either encoded or non-encoded signals, for 
example, television and/or radio signals. Embodiments of such a decoder may include a decoder integral 
with the receiver for decoding the received signals, for example, in a "set-top box", such a decoder 
10 functioning in combination with a physically separate receiver, or a decoder integrated with additional 
elements, such as a web browser or a video recorder or a television. 

As used herein, the tem, "digital transmission system" includes any transmission system for transmitting 
or broadcasting for example primarily audiovisual or multimedia digital data. Whilst the present invention 
1 5 is particularly applicable to a broadcast digital television system, the invention may also.be applicable to a 
fixed telecommunications network for multimedia internet applications, to a closed circuit television, and 
SO on. 



There will now be described, by way of example only, a preferred embodiment of the invention in - 
20 which: 



Figure 1 shows a digital television system including a multimedia terminal in the fomi of a decoder; 
Figure 2 shows the physical elements of the decoder of Figure 1; 

25 

Figure 3 shows the software architecture of the data processing system within the decoder; 
Figure 4 shows the structure of the virtual machine used in the data processing system of Figure 3; 
30 Figure 5 shows a set of predetermined user profiles to be defined in this embodiment of the invention; 
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P,.e e ,He e,e.s„.s o, use. pro,:. aa.a s,o™d ,n ... decode, n,e.o^ -or ea* o, ,he use, 
profiles of Figure 5: and 

p;g„,e 7 shovs .he s,r.c.u,e e. Cass «b,a.les w,m^ me app,ica.lo„ Intedaoe laye, o, ,he so«ware 
archilaaure .o be used in Bie defW.ton of me user profiles. 

^ ov^.w Of a digKa, .eie^ion s,s.e. f acoordina .0 me p»sen. inv^.- is sbo», : Figu. , . The 

^Cudes a mos,, conven.^na, dig»a, f^ev^i. s,s,em 2 fha, uses ,he ^ MPEG-, 
e^press^n s... .0 .a„s.» -P-sed *»a, s*a.. in n,=,e de«. MPEG. oo.p,esso, 3 .a 
p^oadoas. cen.. recess a di,«ai si,nai s..a. ,^.a., a s.ea. of .deo s„na.). TPe con^pfesso, 
coonecffid .0 a multiplexer and sorar.*ler 4 by linkage 5. 

rne ™»ip.e«er 4 receives a piura.»y of fudber ,npu. sisals, assembles me .anspod stream and 
,rans.,scS.pHss-eddig.lW-.- 

. course .aKe a «fde verify of forms including .e^mmun^.ions ,i„Ks. Tbe ,ransm«er 6 uansm»s 
„gne..signa..auplin.a.owa,dsasa.l,i,e.ranspo,^r..*ere.bevaree— ^ 

processed and broadoas. .a no..na, down,.K ,0 .0 eadb rece^r , conven.iona.y ,n me -orm 

ovrned or rented by ,ne end user. Tbe signals received by receiver 1. are .ansm»ed » an 
„egra,ed receiver/decode, ,3 o«ned or rented by me end user and connected to me end use.s 
.elevis.n set U. Tbe reoe.er,decoder , 3 decodes me compressed MPEG. s,nal into a .e.v,s,on 
Signal for the television set 14. 

omer transpod cbanne. for ,ransm.s.„ of me data are o, course possib^. s"cH as terrestda, 
broadcast, cable transmission, combined sateilite/cable links, te^phone neb»orKs etc. 

,„ a muHicbannel system, .be mu,iplexer 4 band^s audio and vfdeo informat^n received frc^ a 
number o, parallel sources and mteracts «,b the transm».er e to broadest tbe information along a 
corresponding number o, cbannels. In addUion to aud.v.ua, infomtaUon, messages or appi.abons 
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or any other sort of digital data may be introduced in some or all of these channels interlaced with the 
transmitted digital audio and video information. 



A conditional access system 15 is connected to the multiplexer 4 and the receiver/decoder 13. and is 
5 located partly in the broadcast centre and partly in the decoder. It enables the end user to access 
digital television broadcasts from one or more broadcast suppliers. A smartcard. capable of 
deciphering messages relating to commercial offers (that is. one or several television programmes 
sold by the broadcast supplier), can be inserted into the receiver/decoder 1 3. Using the decoder 13 
and smartcard. the end user may purchase commercial offers in either a subscription mode or a 
10 pay-per-view mode. In practice, the decoder may be configured to handle multiple access control 
systems, e.g. of the Simulcrypt or Multicrypf design. 

AS mentioned above, programmes transmitted by the system are scrambled at the multiplexer 4. the 
conditions and encryption keys applied to a given transmission being determined by the access 
15-_controlsystem.l5. Transmission.of scrambled data in this v.ay is well known in thefield of pay TV 

systems. Typically, scrambled data is transmitted together with a control word for descrambling of the 
data, the control word itself being encrypted by a so-called exploitation key and transmitted in 
encrypted form. 



20 The scrambled data and encrypted control word are then received by the decoder 13 having access to 
an equivalent of the exploitation key stored on a smart card inserted in the decoder to decrypt the 
encrypted control word and thereafter descramble the transmitted data. A paid-up subscriber will 
receive, for example, in a broadcast monthly ECf. (Entitlement Control Message) the exploitation key 
necessary to decrypt the encrypted control word so as to permit viewing of the transmission. 



25 



An ,„,.rac,ive system ,6, also conneceo ,c ,he mumplexar 4 .„d .he raceiver/dacodar 13 and again 
locatad panly ^ ,ha broadcast cen« and pamy in ,ha daoodar, anablas .he and user ,o Warac, ym> 
various applications via a moder, back channel ,7. The modem back channel may also be used .or 
communicalons used m me conditional access system ,5. An interactiva system may be used lor 
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e,a.pis, .0 ena»,e -H. v^e, .0 .o^muniCe i...d,a,.. w«h ,.s ..ns..s,oo csn.e .0 demand 



authorisation 



ion to watch a particular event, download an application etc. 



5 



«e,e.., .0 F,u™ a, me physical e,e™n,s o, me ,ece,.s« ,3 o, seHop box adap.ed .0 bs 
„sed in ,ne present Invention - now be descHbed. The elements eno»n In ... .I9ure - be 

described in terms of functional blocks. 



The 

ai 



10 



15 



,„ encode, ,3 oompn.es a oent., P-ooessc aO Inoloding associated memoty elements end 
(connected to the modem back channel 17of Figl). 

™ decoder Is addlt.nal„ adapted tc receive Inputs ,rom an Intra-red remote contr. .5 via a control 
„„|, .e and tr^ switch contacts on the .r.t pane, o, the decoder. The decoder also possesses 
^3madcardreac.rs...Sadapted,oreadban.orsobsor.tlonsmancer.«.30respect„.^^^ 

tnpu. may a^ be rea.^d via .n »«r.-red « (ho. Shown,. The subsodp«on sma«ca,d re ^er 
.LJeswlthanlnseneds.bscnptloncard30and.thacond,tionalaccessdn».,osdpplv.h^ 
necessary cont,olword.oadem„»lplexe.descrambler 30.0 enab.thee,.-yp.edbroadcasts.nal,o 

:^crlbled. Thedeoodera.olnolodesaoonvent.na,t.ner3, and demodulator 3. to receive 
,nd demodu^te the sate«e transmission betore being tmered and demu.p.xed by the un» 30. 
" P„cess,n..da«w«n.edecode...enera,lyhandledby.heoentra,processor.O.Theso«w.^ 
architecture o, the cent,al pressor corresponds to a virtual machine ,n.eracUn. wnh a lower .v. 
operating system Implemented In the hardware components o. m. decoder. 

I II rnnrn -rTF" -orMrrecruPE 

Tum.gno„.omearch„ectureo,..sys.emw«nmerece.e,/decodershown«Plgure3,lt,-beseen 
^.a.yeredarch»ec.ure.use. The ... layer . represents the opera*g sy^ o. me — o, 

recer/decoder. This . a reaK^e opera»ng sy^em chosen by me manulacrer .0 control me 
nard„aree.men.o,therecelver.decoder. The re..tlme operating sys.emhasare.«ve..as.respon. 
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time in order to be able to correctly synchronise hardware operations. Event messages are passed 
between this layer and the middleware layer 42 immediately above. 

The data processing system ste on top of the hardware operat,ng system and comprises a middleware 

5 layer 42 and an application interface layer 43. 

The middleware layer 42 is written in a language such as C ANSI and comprises the elements of a virtual 
machine 44 and a number of interfaces 45 including a graphical interface 46. a FLASH/PROM memory 
interface 47. a protocol interface 48 and a device interface 49. 



10 



The present invention uses a virtual machine in order to provide independence between upper level 
applications and the lower level operating system implemented by the set top box manufacturer. The 
interfaces 45 provide the link between operations of the virtual machine and the lower level operating 
system 41 and also include a number of intem^ediate level application modules more easily executed at 



15 - this level. 



20 



The application interface (API) layer 43 comprises a number of high level packages 50-55. written in an 
obJectH^riented interpretative language, such as Java. These packages provide an interface between the 
applications created by the sendee provider (interactK^e program guide, teleshopping. internet browser 
etc) and the virtual machine of the system. Examples of such applications are given below. 



The lower level OS is nom,ally embedded in the hardware components of the decoder, although in some 
realisations, the lower level OS can be downloaded. The middleware and application interface layer 
packages can be downloaded into the RAf^ or FLASH memory of the decoder from a broadcast 
25 transmission. Altematively. some or all of the middleware or application intertace layer elements can be 
stored in the ROM or (if present) FLASH memory of the decoder. The decoder may even include a hard 
disc or DVD drive for memory storage purposes. As will be understood, the physical organisation of the 
memory elements of the decoder is distinct from the logical organisation of the memory. 
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APPi ir.ATIQN INTERFACE LAYER 

,0 app,.a..„ ...ace ,ave, .3 . B,u,e 3. an. as ^. - Pa*^- - 

,« a,e «-«.en * an obiac o,.n,ed ,an.^ge .uch as Oava. EaC paoKa^ de.lnas a sa, o, Cass 
,.,a,.s ca« on duHng <,pa.«^ o, ,ne s,s»n. In ^ prasan, svs.a. .ne ,o,^n. pacKagas : 



; are 



installed. 

PacKa^e 50. Tn. pa*a,a ^«nes ,na Casses ne^essa. .o, .na .an,pu,a.»n o, o,e«s P, 
.„ua, .aC^na. THesa Cass *,anas no™.v -onn pa. o. a s,.da,d U..^ assoCa»d .a 

oriented language chosen. 

MHBG-S Pa«a.a 51 . Tn. pad<a,a <.«nas ,ne Cassas asaoCa,ed ^ ma .a„,p.a«on o, ,rapn^i 
oplecs on ma .a,a*io„ d,sp.y. Su* oNaCs a,a .s^ Ur^ au..v.ua, aa. and can .a. up, ,o, 
«a.p., onanna, :aan„:a. or ^ ova, .Maya. ,.a,as. Tna ^ C 

pa«a^ sno* .^ac«rMHHG.5 nws da,inad bvma s^n^as-ETS 300777.3 and ,SO/,SE ,3522 
5 (and ma slandard ISO/ISE ,3522.6 m ma casa of a Java Implamanlad systam). 
™,P0. Pa*a,a52. pao.,a contains ma o.ssas usad .or do«n,oa*, and daco.prass»n o, 
„o™«on as wa. as ma assoCatad .m ma .ana,^a„. C ma s,s.an, and ^ »*.n 

^a raoalvar/dacodar and ma Cassas assoc^ad w«h ma connaoSon .0 me in.an,a, a«. 

Oav.aPac.aga 53. T.. paC<a9a dafinas ma Cassas nacassary ,or managa^an. C padpher^ 
a„ac.ad .0 ma ,aca.a,« as d^ussad a.ova and ,nc,ud,ng ma nnod«., ma smaK card raadars, 

the MPEG flow tuner etc. 



Pacaga 54. This pacKaga dalinas ma Cassas nacassary ,0, me imp,a.anta«on o, deva«ping 
Ngnar lave, in,arac*e applica»ons, sucn as managemen. o. cred» can, daB eK. 



Service 
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DSMCC-UU PacKage 55. T.. pacKaga i.p,^a* ,ha protocols necessary ,or co,„.»ica,„„ .e^«en 
a can, and a serve, ,or da,a ,«e search and raa*9. lmp,e.en,a.on o. ,h,s package should respec, ,he 
nom. ISO/IEC 13818-6 and directives defined in DAVIC pan 9. 

in nor^a, operation, a ,u,«,e, layer o, i„,erac«ve applications, written by the service provider and 
do»„loadsd during broadcast as in conven.^, syater^s. »il, be ,a« over me intedace pac^ges de,ir«d 
ahova. T^ese appi^t^ns topically ™,„de a gene.1 a^iication manager tor managing the detinad baste 
=pera«ons o, the decoder, and one or more op«ona, ap^,ca,ion« ad«ng add»iona, services. In pa^cular 
a use, manager application may be used to manage use, prionty contlicts. as « be described below. 

Depending on the applicattonsto be ir^ducad. some p, the above pacKages may be omrned. For 

example, if the service provider doe<; nnt intor^H « 

P viaer does not intend to provide a common way for data reading, the DSMCC- 

UU package may be left out of the final system. 

15 The packages 43 provide class libraries for an obiect oriPntoH r,r« 

— opject-onented pro^ enyiroriment. Their class 

behaviour will depend on the languaoe chosen irnh^r^^^^ . . ^ " 

guage cnosen. In the case of a Java application, for example, a single 

inheritance class structure will be adhered to. 

As will be understood, the grouping of a class nr = cot „f 

y P "9 a Class or a set of classes in a package is a matter of formalism 

20 w«h,espec,to^,unc«ona,i.yo,aclass. Ce„a,„ cesses reUted to ma^gement o, pehphe., deuces 

may be, ,o, e«mp«, cla3s,»d e«her as be,ong»,g to the De>.ce Package 53 or the S«*e Package 54. 

INTERFAHF I AVFP 
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AS Shown, the interlace layer is competed o, ,ou, modules, a graphics modute 46, a memoiy ,,ie 

managemen,modu,e46,aprotcco,modu^ 48 andadevfce manager 49. Whi^themo^^ a, th. leva, 
are described as intedace modu^ their ...ctlon is to pro^de a w layer tor me imp^entation o, the 
app«ca,ion intedace packages and to, the operation of the virtual machine generally 



ISDOCID: <WO__9945709A1_L> 



^ ^ PCTAB99/00461 

WO 99/45709 

The graphics module 46, lo, example, providee .he creation and ma„ager„en. o. graphical obiecB. « 
asKs me to» level OS to display basic graphic shapes s«:h as s We pixels, lines, rectangles etc. The 
implementation o, th. module depends on the 9raph«=s capability o. the « level manu.acture,-s OS. in 
some ways complementary to the MHEG-S parage 5, , these tunc^ns may be mo. eHicien.^ executed 
at this code level than in the high level code chosen lor the application layer above. 

in a slml^r manner, the memo^ .lie management module 47 indudes lo« level readMrite tile commands 
assoc^ted ^ the memoiy components o. the system. Typically, the hardware operating system only 
i™:|udes commands .^cessary to read*„ite a sector or page -hin a memon, component. As with the 
graphfcs module 46, *is modute enables a set o. simpler lower level applications to be eflicien.ly 

introduced in the system. 

The protocol management module 48 detlnes a «bra,y of oommunication protocol that may be called 
upon m communications via, lor example, the TCP/IP layer ot the decoder. 

The device manager 49 is sr«ht^ d«.erent trom the other modules m this layer in that it provides the linK 
or mtertace be^»een the hardware operating system and the layers above, including the other modules . 
the mtenace ^yer and the vinua, machine. Commands or e^nt messages that are ,eoeived«ent to the 
hardware OS from the vindal machine, lo. example, are neoessarl^ passed by the device manager ,or 
conversion according to the intedace speoHicallons between the two levels. 

>nt.T^I»l MAC """" ""■''''■"IPTION 

Relerhng now to Figure 4, the stmcture ol the virtual machine 44 used in the system of .he present 
invention - be descried. The «ua, mach^e used in «,e presen, Invemlon . a pre-emp»ve mu^read 
type machine. The general charactehsdcs o. such a machUte are Known m other context and *e 
creation ot code to, implementatlon of such a machine will be within the scope of one sidlled in the art. 

The Virtual machine . composed ol a number of elements, which ln.«ac. broadb, as shown in Figure 4. 

, 61 and a monitor manager service €2, forms 



The scheduler 60, composed of a thread manager 



service * 



10 
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the heart of the multithread machine. The scheduler 60 orders the executior, of threads created by 
applications externally of the virtual machine and those created by the virtual machine Itsetf (e.g. a 
garbage collection thread as discussed below). 

Th. even, manager 63 handles an even, ,ou,in9 ,a.,e end ,he lisls o, evems .ubecribed ,o by ,he ,h,eads 
and centralises the dispatch of event treatments. 

The memory manager 64 handles the allocation and disallocation of the memory zones ^in the system 
memory and also handles the removal from the memory of non-referenced objects (garbage collection). 

The Class manager 65 charges the classes of the application code dov^loaded in a broadcast signal, 
interacting with the security manager 66 to check the integrity of downloaded code and with the file 
manager 68, which implements the applications. 

15 The ,M manage, 68 carries ou, ,he imp,en,en,a«on e, ^ eys,en, files and «e handles .he mechanlsn, c 
downloading of interactive applications and data. 

The security manager 66 handles the level of access pemiltted to downloaded applications, some " 
applications having the ability to carry out more operations than others in relation to the file system 

20 

The interpreter 67 comprising a byfecode interpretation service 69 and a -m-code" interpretation service 
.70 handles the interpretation of applications wntten in these two codes, bytecode being associated with 
Java applications and m-code being the name given to a proprietary code developed by the applicants. 

25 USER PRQFII P.q 

The increasing hard»a,e processing p„.^, has led ,0 «,e inceashg use o, 

decoders in »,e o, in,on.a«on beKveen a number C pcen.ia, use,, o, tt,e system. For example a 
singte IRD can seive as ,he ^pu, poin, ,or a b,.ad=as, MPEG s„eam, ,his srream being pmcessed and 
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a PC or DVD device connecled via an EEE 1394 bus etc. 

«a ce.„a, ,o ..e prese., e..<«n.e„. ,s o, a ^ o. -use.- 0, .e *co.e. e^. 
, .e.av..ace«.nc.a.c,e^.P™™e. e«a.p.. a ,eve, ap.-..n .a, ae,^ a n^.r . 
..p,o...o,a.e,ev.«v^.aVHS..«..ape^.ec.usl..e.aco..»ao^»« 
,„,e™., a person us., .e ,o.e -pn..^ » a PC e.c. ...e S an e^p. 

:,^.a,userp-pr.s.T....nna,Peexpan.e..o^,u...ore«^p,e,aDVD.e.ePonnsc«a»^ 

decoder etc. , 
" .userp.o.»en,a,Peae«ne..re,a..n.pane«erna,c.v^connec.e..o.e™,naU<.rex^^^^^^ 

eonnecn ,.ev.«n. .*«e ,ne ,e,™ina, s,.p. supp,^ au*v.ua, .a,a .o .e .e.v,s„n «p.,. 
Zerp,o,,:e.a,a.p.ae.,ne.,n,e...n.o.eac.n.en»vo.oneor.orep..-,p.rsons 

or "operators" accessing the terminal. ....... _ 

" ,p.ep,esen,case._au.,pro„:e,sP.ne.,nre.,,on,oa.p.eo.opera.n^^ 
3ucHas„sope,a«on.anln.eme..ode.Eacnuse,prp.«ede,ine..cronese.upp,modeo. 

:InJv..Pe— .o..He..ere..parsonsus,n,.ec.Po.er.e..,na.^ 
prI™vle.He,en,.e.v.,p™..ornano.er.o-.a,PeprpH«e..,p.wa«n,n, 
.0 :lp.aL. Tne— e.a.n,.ep.™o.eacnpe,.n-,ss.p....:n.euse, 

profile for that mode of operation. 

^use,..!. — aun,puean.pHa,^e.s„c.e.Dan.oneo,.o-ep.^va,ues.e.e„.«n. 
"p.J...use.no^,*,pne..o..ecoaa._,n..pase..He».™ 
,S IIJ— .o..ePec=.,suc.asaccess.o.a.e.u,«p..e.oao^,paase^e.^ 

r....ve,app^«on.a„a...e.,nesan.s.p.s.e— .-^--P-"---^ 
«,e sharing o. resources and user conllics v» ra<e™nce ,o me user prlonty. 

..o,exa.np..auser.ana.ern,a,alvepr.rl..oeuser-.EOOBD.R-.ore^p..su=H.a.ada™^ 
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15 



as 



resource. In particular, the user "RECORDER" may have preference over the user "VIEWER" as far 
choice of demux channel is concerned. In this way. the application prevents a change channel signal 
received from a viewer from taking priority over the channel chosen by someone wishing to record a 
program being transmitted at the same time. 



In this example, where a single priority value is assigned to each user, the user "RECORDER" will always 
take priority over 'VIEWER" for access to any resource. Alternatively, multiple priority values may be 
assigned, such that "VIEWER" has priority for certain resources. "RECORDER" priority for others etc. 

1 0 The priority evaluation is handled by the user manager and may be interactive, i.e. an operator may 

detemiine by programming the decoder with the handset whether to give priority to an internet connection 
over television viewing etc. 



Each user profile includes, in addition to the user ID value, a set of preferences stored in a cache memory 
in the decoder, for example, in the FLASH memory of the decoder. These preferences will be called up 
by the application upon at each booting up of the decoder As shown in Figure 6. user profile data 80 
includes resource data 81. attribute data 82, and action data 83. 



The resource data 81 includes a list of internal decoder resources that may be accessed by the user. 
20 for example, access to the MPEG tuner and descrambler. As will be understood, a resource in this 
context refers to a logical resource relating to a combination of physical elements associated with a 
demux process, a conditional access system etc. 



Attribute data 82 includes preferred attributes specific to that user, for example, the language (English. 
25 French. Gemian etc.) that will be preferentially used in written displays on the screen, the morality 
level of programmes that can be viewed by the user etc. The Action data 83 includes a list of 
permitted actions that may be carried out by that user, including change channel etc. 



30 



The user profile data can include fixed values predetermined by the user manager (for example, all users 
are capable of accessing the resources of the tuner, the demultiplexer etc.) as well as values modifiable 
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pe.ona.sea ,o ea.. op.a,o, capa.e o, us,„. .e-..a, . ea* ope.a«n, ^ (^o.,^ 
Of programmes that may be watched etc.). 

va,u^ ^odHiab^ b, a. ope.», can v^ues .or eao. use, prCI^ sa. an ope,a.or a. «,a 

.o^en, o, a,a«.up o, .e decode, as we. va,ues se, by an ope«.o, ea* «e a session . s.ned v* a 

particular user profile. 

™ de.in«ton o, .u,«P^ user pro.,^ corresponding » ^des C opera«on and ^iu-ng data ,e«ard^9 
p,^*y.o,en.ina. resou.es ,orea*prc„epaves*ewa,.orpa,a.e,precessin,o.sucnmodes^*e 

,ar.,na,soas.ope,mMorexamp,e.asing,e.e^in^.ohand^ and process da.a,orviev*gv,aa 
,e^v^^a..esame«n«as.o™ard^«da.,o.e recorded .yanassoc.a,adrecor«ngdev«e, 
,rea.edbyaPC etc. .n such sys,^ .he rermina, becomes e«ec«ve,yada,a hub loranumbero, 
associared poHphe,^ dev^s o^«ng in par^iei. Th. sort - opsraUon is pan^iany we. managed by 
a mu^raad sys,em C ^e .ind in .eia.K. » Figures 3 a^ 4. and as wU, now be descnbed. 

,no«.r,opem,«.hecrea«on^aseheso,use,pro«s,«isde.rab..oin«^w«n»»AP,^ver 
o«ec.c^esadap.ed»engage*mev«uaimach^e.oacb^.h..Re.erringbacK.o Figures, and 

3S cscussed above, -he Cass iibra,^ de.ined : ^ AP, iayer 43 supp,y »« par^e.*- o. opera,«n 
^ Which higher .ve, app*=a.o„s may ope.,e. in particuiar, in camW ou. ce.«. ac«ons, a h* 
,evei appfcason wni »,Cude ,nsm,«ions referring .o classes o. obieoU defined ^ .his iayer. 

Each cass-respec. .he rules o,««=MeCorien.edprogran^ing.anguage Chosen .or m,s.ayer. 
Ty^c^ c^iec. c^ses InCude Csses re^,ing .o me managemen. o. .he pons o. .he decoder, such as .he 
„e« card «.edace, as we. as o.her opera«ons such as managemen, o. *e access con.™. sys.em. 
„^bero.sUndardc^.«AP,.yer have been de,inedby me OAVIC group ,nrela..on,o.,or 

example, access lo seOions and Hbies in a downloaded MPEG sream. 

There - now be desc^. w* re,ere„ce ,o Rgure 7. a s»^ure o. .asses adap.ed ,c prov«e me 
„ o. de«ng use. preierences .or each s..h user and .o .a.,«a.e me handling c. m.*p. ..«s 
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by a high ievel application. The classes that will be described may be included, for example, in the 
Service Package 54 installed in the API layer 43. 



Referring to Figure 7. a class UserCacheManager shown at 90 is used to permit applications to access 
5 and manage user profile data stored in the nnemory cache of the system. This class is a static class. As 
with standard object oriented program architectures, the class library includes a list of methods or 
commands such as a method initialiseQ to initialise the memory cache, a method getMaxUserProfilesQ to 
know the maximum number of users to be supported by the system, a method getActiveUserlDQ to know 
the number of users currently active etc. The class may also be associated with a list of events, signalling 
10 to the application the occurrence of an event, such as the creation or deletion of a user profile. 

The classes additionally include a class UserProfile shown at 91 . This class is a generic class, adapted to 
permit the creation of a number of user profiles. The class includes a list of methods such as getUserlDQ 
to recover the identity of a user. getPriorityLevel() to recover the priority of access to resources. 
15 setGeneralAttributeO to set the value of a general attribute etc. The class is also associated with a list of 
events indicating, for example, a change of channel demanded by a user etc. 

These methods are methods which pemiit an indirect access to methods, thereby avoiding the necessity 
Of hax^ng a method for each attribute. The number of attributes managed by these methods v«ll depend 
20 on the choice of the system architect and may evolve with time. 

in practice, the choice and functionality of the number of methods in this and the other classes may also 
be detemiined at the discretion of the system architect and in dependence on the processing power of the 
hardware, the characteristics of the virtual machine, the number of functionalities the system architect 

25 wishes to introduce etc. 

AS will be described, some of the methods may be inherited by other classes in accordance with the 
principles of the object oriented language chosen for the application interface layer. 
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,„ ^ CSS. v^-o„. ^. Beco,de,P,o,«e 93. ,n.e.e,P™.. 94. 0.^^,0,^ 35. 

ae,.e .e^ods spec». ,o ^ de,.».n o, .he use, p,o„e VIEWER. RECORDER. INTERNET. - 
OATA BR,DGEe.c. The classes 92 ,0 95 ™, ^dude .emod. ^HeHte. .com gene* Osa,P,-e 
^,39", Forexam^..s«g>heconv.andse,Gehera«nn-bu,e,A,hhu.e.Va,ueo,A»*u>e,.me 
preferred value o, an aW^eassoclaledw^^e user p,o.«e in quesl^h may be dsler^inei 

Ta«^ .he case o. a .e«er ^o* . M.«=h me mo.l»y level o, a v.we, . .c del^^d. .he 

setGeneralAttribute (Morality-Level, 1 8) 

..heccn.ex,c,p™,ra.... .hepro.es ,c.e user VIEWER^se. an au.onseda,eli.iHorm. 
„.er Th.ve.e-hede,inedandca,^upb,ah*er,eve,a^l^«onandcan^used,opre»en. 
access hy*euserVIEWEB.oce,«-.de.uxchannete.un«ss.^opara,ordeclarash^ age. Fc each 

person hav^ access » .a decoder In .e .ode VIEWER, a se. o. pre.erences n«, .us he de,.ed hy 
instances within the class VIEWER. 

As-heundars,ood,.hede,ln.io.ln«APIo.an^bero,c^esspeo»^»mecrea.ono,a„ 
.^ntrredWenah^smes,^ .oeas»yde,.eapl.a«yo, user premier each o„heseuse.s.The 

prcs^ o, a ^ UserCacneManager pen.«s .e handle C cached p™.lle da. relying «. a user, 
.e gener. c^es Use,Pro„. and .he suh^ses .«»e.Pro„le. RecorderProine e.. pro»de 



tools 



necessary for the definition of each user profile. 



Theaxacc^posl-^anddsnn^on erne memodsar^ evenu,*lnmase ca^ lsha»«ver 
dlscre^ona. and . - he -hin .e co.pe.ence o, ^e sKllled In .he a« .o de.e,h.^ Pes, de,.^n C 
such object in dependence cn .he charac.eris«cs C .he chosen v.r.ual n«chlne ete. 
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CLAIMS 



1 . A terminal for processirig digital audio-visual or multimedia data including a data processing system 
and a memory, characterised in that the data processing system stores in the memory user profile data 
5 relating to the characteristics or preferences of a plurality of types of user of the temiinal. 

2. A temiinal as claimed in claim 1 . where the user profile is defined in relation to a mode of operation of 
the terminal. 



10 3. A temiinal as claimed in claim 1 or 2. where the user profile is defined in relation to the connection of 
an external device. 



4. A temiinal as claimed in any preceding claim, where a user profile is personalised in relation to the 
identity of the operator. 



15 



5. A temiinal as claimed in any preceding claim, where the user profile data includes resource data 
indicating the resources within the temninal accessible by each user. 

6. A terminal as claimed in claim 5 where the i icar nrr^u^ • ■ ^ ■ . 

dim o wnere the user profile data includes priority data Indicating the priority 

20 of each user in respect of access to one or more resources of the temiinal. 

7. A temiinal as claimed in any preceding claim where the user profile data comprises data relating to the 
attributes of information to be supplied to each user. 

25 8. A temiinal as claimed in any preceding claim where the user profile data comprises data relating to the 
actions permitted by each user. 

9. A temiinai as clawed in any preceding claim where some or all of the characteristics or preferences of 
the user profile data are modifiable during nomial operation of the temiinal by an operator. 

30 
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,0. A .em,^l Claimed in an, preceding Cairn ^.e some or a» o. me user pro.iie dau . 
p,odetem.ined by the data processing system ol the temtinal. 

„ A,enm.na,asc,a^ed^anyp,eoedingc,aim^erethe,em,inaic^P-isesadatap,ocess-.9system 
compr^ing, «er a,^, a ^rtua, machine and an ohiec ohented application «ertace compns.g a 

plurality of class libraries. 

,a Mem,.a,asCa^ed^c,aim,1.in.*ichtheapp,tot,oninteHaoeiayermaycomprtseoneo,more 
ctes Bhraries deflnlng the operat»n o. the vinuai ma=h«e «ith respect ,0 user prof»e data. 

13 A tem,»«l as c^p«d m oiaim „ or 12. in which the app.k=a«on »,>e,.ace layer comprises a dass 
,^ra,Vded.ated.omemo,ymanag^nf.userpro«ledatain««memo^ca=heo,thetenn.al. 

,4 Ate,m^^ascla»™dinanyo,cla^s11to13inwh«=h,heapp,ica«on^tenace,ayercompdsesone 
or more user pr^.^ Class lib,ahesada^edtode.ine.hechara«^a..hi«^.obe stored,n theuser. 

profiles. 

15 Atem.nalascla^ed,ncteim«.in^«htheuse,pro,«ec,ass,»,ra^comphseage.«ncCass 
.praryassoc^ted^thedet^iiti^o, genera charaoe^cso, user pmti^ data, andone or mores,*- 
ciass llPrahes associated .* the de«,ons o. characUris«cs assoc^ed with a spec«ic user pro.ie. 

,6. A temtinal as c^»ned in any preceding Calm comprising a decoder adapted to recede data 
transmissions in a digital transmission system. 

17 A memod 0, operatic ot a ten.-.a, tor processing d*MI aud^visua, or mu»me«a data include a 
da« processing system and a cache memory characterised by the step o. storing . me terminal memo, 
use, proflle retet^ to the characteristics or preferences o. plurality o, users of the temtinaf. 



wo 99/45709 

PCT/IB99/0046I 

20 

18. A terminal for processing digital audio-visual or multimedia data substantially as herein 
described. 



1 9. A method of operation of a terminal for processing digital audio-visual or multimedia data 
substantially as herein described. 
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Description 

BACKGROUND OF THE INVENTION 
1 . Field of the Invention 

[0001] The present invention relates to an user orofile 

Z^'^T.TrT' Of SiS 

same and m^ '*' ''^^''"S "^^^f^^d using the 
medfa dataTnd^/'''''^'^ '° " ^°"'«nt-based.multi- 

userleflrrrrfK •^"'^ ^^^'^"^ ^f^i^h an 

user-preferred browsing method is contained in an u^Pr 

eTce isZ^er ''^ """^'"^ ''''' onl'se"r preTe " 
fnrmJ ^" user-prefen-ed browsing in- 

2. Description of the Background Art 

[0002] in multimedia data indexing and browsina in 
a^nventional art. there have been introduced tech 

o::s^:;e;::s ^'^^"^'-^ -^-'^'-^'^ ^-d 

[0003] In intemet shopping by using of a multimedia 

erence there .s a method of selecting only preferred 
tems stored in an user profile by each user and S ay 
ng each product in a different way. not dispSg 1 
onja .on ,tems used in the intemet shopping' ' 

uses pnce and specification information, some user 
mainly uses design infomiation. and some useTmaTnt 

•n Checking electronic products through the internet 
Shopping, each user is given the above prefe'edfrJor 
mationasitsown userprofile: In case that an user rTlin. 

y uses price and specification in this preferred'' or^a 
tion merely the information containing only P SeTnd 
specification is displayed to the user aShough oSr in 
formation such as photographs is provided by the u er 

des,gn(photograph) infomiation is mainly displayed In 
th.s way, the information appropriate forthe preference 
of each user is displayed. iJ>«ierence 

[0005] In addition, there have been introduced tPrh 
niques for providing a temiinal desk-top mS such 
as a computer to an user in an user-desired form in g 
mu^hmedia indexing and browsing system bas d on s 
er preference in the conventional art 
[0006] In other words, the terminal desk-top interface 

erl . h''°''''''°"^'"9 "'^^ (o^ designates) is 

recorded ,n its userprofile, and then the form of he in 

Slotrr."' userprofi.: ifp;:. 

[0007] Besides, there have been techniques for sun 
pomng help information in the fomi that ushers 

zzv:t' ''''' °' 
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^^e^::^^^^:^ :^^nt;raraS 

^ [0009] Nowadays, the content description is de- 

r^Tr^JJV"'" coment-based 
multimedia mdex.ng/browsing. In the case the various 
browsing method are possible, so if there is the iZ 
ma ion describing user preference, user can browse 

[0010] In other words, among a variety of browsers 
for performing content-based multimedia data indexing 
and browsing, there may be browsers that is particuterl? 
^'^ preferred, or browsers that is preferred by the type 2 

nance and management of such data is not achieved 
he user cannot enjoy his or her right to various Sec- 

^0 restrictively provided in a given environment. 

SUMMARY OF THE INVENTION 



25 S° ^^''''^^'"S'y- it is an object of the present inven- 
1 1° ^T''^ ' "'^^ P™"'^ '^^ormaZ structure in 

i^nl^f '"'^'^'"S browsing ca be 
implemented in an user-preferred browsing form and a 
multimedia data browsing method using the Se ' 

30 nr } '® °f 'l^e present invention to 

^0 provide an user profile infomiation structure in wh ch an 
user-preferred browsing method is contained fo^ drs- 
Playing the multimedia data in an user preferred fon^ 
and a multimedia data browsing method using t^e 
-3 browsing."""""'"""^ ^^'^ indexing%nd 

S!ovi?p Jn ^"°''f' °' '""^ P^^^^"t '"-e^t'on to 

uSr oreferi'^H''^ ^^'^^^ an 

user-preferred browsing method is checked from an us- 

er profile, and an application(or browser) is desianated 
l^f'"' '-f t-^ere are p.ura^'of fp 
phcations providing the corresponding browsing meth- 
od, or an application satisfying the co?responS se^ 
ice IS downloaded from other designated place and is 
provided to the user if there is not such an application 

same' ""'^ "'^^^^^ ^^^^^^^^^ 

[0014] To achieve the above objects, in content- 
based multimedia data browsing, there is provided an 
user profile infomiation structure according to the 
present invention, which includes an user-preferred ap 

21^1^0^^"'^' ^" ''''-''^'^''^^ ~^ 

[0015] In addition, the user-prefen-ed application de- 

cation ID. or application locator 

storlri in Ihf '""^ ^PPW'^^t'o" description scheme 
stored in the above userprofile further includes a layout 
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description scheme of an application. 
[0017] In addition, the number of user-preferred ap- 
plication description schemes stored in the user profile 
may be plural, and each of the application description 
schemes further includes a weight describing user pref- 5 
erence. 

[0018] In addition, the user-preferred application de- 
scription schemes stored in the user profile are different 
from one another according to the type(genre) of a mul- 
timedia data object, each of the application description io 
schemes is structured hierarchically, and the part of the 
application description scheme having a weight describ- 
ing scheme based on user preference. 
[001 9] To achieve the above objects of the present in- 
vention, in contents-based multimedia data browsing, ^5 
there is provided a multimedia data browsing method 
according to the present invention which is character- 
ized in that: (a) multimedia data contains a contents de- 
scription scheme for indexing/browsing multimedia da- 
ta; (b) an user profile includes an user preference de- 20 
scription scheme indicating an user-preferred multime- 
dia browsing method or browsing criterion as an appli- 
cation description scheme for user-preferred browsing; 
and (c) multimedia data is browsed based on the user- 
preferred application description scheme for user-pre- 25 
ferred browsing in a corresponding user profile, if the 
user desires multimedia browsing. In addition, in the 
multimedia data browsing method of the present inven- 
tion,-the user-preferred multimedia data browsing meth- 
od or browsing criterion are described differently ac- 30 
cording to the type or genre of multimedia data, and a 
multimedia data is browsed based on the description 
scheme describing each user-preferred browsing meth- 
od or browsing criterion. 

[0020] In addition, in the multimedia data browsing 35 
method of the present invention, the user-preferred mul- 
timedia browsing method or browsing criterion is a char- 
acter-oriented browsing, character/place relation-ori- 
ented browsing, time sequential and scene-oriented 
browsing, or combination thereof, 
[0021] In addition, in the multimedia data browsing 
method of the present invention, the number of browsing 
method or browsing criterion described differently ac- 
cording to the type of multimedia data may be one or 
plural with respect to one type(genre) thereof, and ^5 
weighted values can be added on these browsing meth- 
ods or browsing criteria. 

[0022] In addition, in the multimedia data browsing 
method of the present invention, if there is no application 
satisfying the user-preferred multimedia browsing meth- so 
od or browsing criterion in the current terminal, in dis- 
playing the corresponding multimedia data, such an ap- 
plication is downloaded(or plugged-in) for thereby im- 
plementing the same. 

[0023] In addition, in the multimedia data browsing 55 
method of the present invention, if there are a plurality 
of applications satisfying the user-preferred multimedia 
browsing method or browsing criterion in the current ter- 



minal, in displaying the con^esponding multimedia object 
based on the user-preferred multimedia browsing meth- 
od or browsing criterion, a locator of an application or 
browser is included so as to select an appropriate ap- 
plication among the plurality of applications, and the 
multimedia object is displayed by selecting the applica- 
tion indicated by the locator of the application or brows- 
er. 

[0024] Additional advantages, objects and features of 
the invention will become more apparent from the de- 
scription which follows. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0025] The present invention will become better un- 
derstood with reference to the accompanying drawings 
which are given only by way of illustration and thus are 
not limitative of the present invention, wherein: 

Figure 1 is a schematic view illustrating the con- 
struction of a multimedia system according to the 
present invention; 

Figure 2 is a view illustrating an example of a con- 
tents description scheme structure of a multimedia 
object according to the preserit invention; 
Figure 3 is a view illustrating an user profile infor- 
mation data structure according to a first embodi- 
ment of the present invention, 
Figure 4_is-a view illustrating, an user prof!le_infor- 
mation data structure according to a second em- 
bodiment of the present invention; 
Figure 5 is a view illustrating a preference descrip- 
tion scheme iri an user profile information data 
structure according to the present invention; 
Figure 6 is a view illustrating an example of a brows- 
ing based on user preference. 
Figure 7 is a view illustrating another example of a 
preference description scheme in an user profile in- 
formation data staicture according to the present in- 
vention, and 

Figure 8 is a view illustrating another example of a 
browsing based on user preference. 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

[0026] The preferred embodiments of the present in- 
vention will now be described in detail with reference to 
the accompanying drawings. 

[0027] First, Figure 1 is a schematic view illustrating 
an example of the construction of a multimedia data 
service system according to the present invention; 
[0028] A multimedia object 101 has a contents de- 
scription 1 01 a for content-based indexing/browsing and 
a data stream lOlb. 

[0029] A terminal 102 includes a central processing 
unit 103 for performing content-based multimedia index- 
ing and browsing control, a memory 104 for storing a 
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variety of data, a display device 105 for displaying var- 
ious information relating to multimedia data indexing 
and browsing, an user profile reader 1 06 for reading us- 
er profile information, and an user profile. 
[0030] Here, the user profile reader 1 06 can have the 
function of a writer for updating information recorded in 
the user profile 107 based on the feedback of an user 
[0031] In addition the user profile 107 can be a mov- 
able medium capable of recording and storing informa- 
tion in the form of a smart card 
[0032] in addition; an user-preferred browsing meth- 
od or browsing criterion is described in the user profile 
107, and such information can be updated by learning. 
[0033] The information contained in the user profile 
1 07 is read out from the user profile reader 1 06, and is 
downloaded to the memory 104. 
[0034] The central processing unit 103 decodes the 
user profile information downloaded to the memory 1 04 
to thus browse the multimedia object 1 01 using the cor- 
responding display device 105 by the user-preferred 
browsing method or browsing criterion. 
[0035] Figure 2 is a view illustrating an example of a 
contents description scheme structure of a multimedia 
object for content-based indexing/browsing according 
to the present invention. 

[0036] The contents description scheme structure 
has an audio visual description scheme 201 including a 
syntactic DS 202 and a semantic DS 203. The syntactic 
DS 202 includes a segment DS 204, region DS 205, and 
segment/region relationar^^^^ 

DS 203 includes an event DS 207, object DS 208, and 
event/object relational graph DS 209. 
[0037] The syntactic DS 202 describes a physical 
structure of actual multimedia data, and has segments 
and regions of the actual multimedia data and informa- 
tion on the relation(link) between them, thus making it 
possible to index and browse a corresponding section 
or scene of the multimedia data. 
[0038] The semantic DS 203 describes a semantic 
structure of multimedia data In case of a multimedia da- 
ta, for example, moving pictures such as drama, events 
objects(characters, places, etc,), and the relation be- 
tween events and characters or places are described, 
thus enabling content-based indexing and browsing of 
multimedia data. 

[0039] The description scheme structure of the multi- 
media data for content-based multimedia data indexing 
and browsing is not limited to that as shown in Figure 2, 
and can be varied in various forms for the purpose of 
more effective browsing. 

[0040] Figure 3 is a view illustrating an user profile in- 
formation data structure for content-based multimedia 
data browsing according to a first embodiment of the 
present invention; 

[0041] The user profile Information data structure has 
a data browsing DS 301 including data type DS 302 and 
a browsing preference DS 303. Such a data browsing 
DS structure can be given by the type or genre of each 



multimedia object. 

[0042] The browsing preference DS 303 corresponds 
to the data type DS 302. 

[0043] The browsing preference DS 303 includes a 
5 browser DS 308 as an application DS satisfying user 

preference and a functionality DS 304 for describing a 

browsing method or browsing criterion. 

[0044] The functionality DS 304 for describing a 

browsing method or browsing criterion has a reference 
to to browser DS 305 for connecting a corresponding 

browser, a function DS 306 for selecting a browser, and 

a weight DS 307 for describing a corresponding weight 

value. 

[0045] The application DS 308 has a weight DS 309, 
15 locator DS 310, and reference to functionality DS 311 
for reference to a description scheme for describing a 
browsing method or standard. 

[0046] Therefore, by means of the user profile relating 
to such a user-preferred browsing method(or browsing 

20 criterion), it is possible to display a certain particular 
multimedia data by the user-preferred browsing method 
or standard in a system of Figures 1 and 2. 
[0047] In other words, when an user displays a multi- 
media data based on the user profile information, a cor- 

25 responding application(browser) satisfying description 
schemes 304 through 307 for describing the user-pre- 
ferred browsing method or standard for the correspond- 
ing data, or having been described in the application de- 
scription schemes 308 through 311 is indexed in the ter- 

30 - minal - . . 

[0048] If the corresponding application exists in the 
terminal, multimedia data is displayed using the same, 
or if it does not exist in the terminal, the corresponding 
application is downloaded using the locator DS 310. 

35 [0049] In addition, the number of application(browser) 
included in the application DS is one or more than one. 
If the number of application is plural, an user-prefen-ed 
application is employed using the weight DS 309 which 
is learned based on user preference(userfeedback/us- 

40 er*s usage pattern of a certain particular browser) for 
each application. 

[0050] Figure 4 is a view illustrating an user profile in- 
formation data structure for content-based multimedia 
browsing according to a second embodiment of the 

45 present invention, which is formed by further including 
a layout description scheme of a browser in addition to 
the structure as described in Figure 3. In this case, the 
user can describe preference on a browser according 
to a certain particular type of multimedia data, but also 

50 can describe layout preference DS of the corresponding 
browser. 

[0051] As illustrated in Figure 4, the user profile infor- 
mation data structure has a data browsing DS 401 in- 
cluding a data type DS 402 and a browsing preference 
55 DS 403. Such a data browsing DS structure can be giv- 
en by the type or genre of each multimedia data. 
[0052] The browsing preference DS 403 con-esponds 
to the data type DS 402. 
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[00531 The browsing preference DS 403 includes a 
browser DS 408 as an application DS satisfying user 
preference, a functionality DS 404 for describing a 
browsing method or browsing criterion, and a layout DS 
413 of the browser 

[0054] The functionality DS 404 for describing a 
browsing method or browsing criterion has a reference 
to browser DS 405 for reference to a coaesponding 
browser, a function DS 406 for selecting a browser, and 
a weight DS 407 for describing a corresponding weight 

V£llU6 

[0055] The application DS 408 has a weight DS 409, 
locator DS 410. reference to functionality DS 411 for ref- 
erence to a description scheme for describing a brows- 
ing method or standard, and reference to layout DS 41 2 
for layout.. 

r0056] The layout DS 41 3 has a weight DS 41 4 for the 
layout and a reference to browser DS 41 6 for reference 
to the browser. 

[0057] Therefore, by means of the user profile relating 
to such a user-preferred browsing method(or browsing 
criterion), it is possible to display a certain particular 
multimedia data by the user-preferred browsing method 
or standard in a system of Figures i and 2. In addition, 
the layout preference DS of the corresponding browser 
can be described. 

[0058] In other words, when an user displays a multi- 
media data based on the user profile information, a cor- 
- responding-application(browser) satisfying descnption 
schemes 404 through 407 for describing the user-pre- 
ferred browsing method or standard for the correspond- 
ing object, or having been described in the application 
description schemes 408 through 411 is indexed in the 

terminal. ^ , 

[00591 At this time, an user-preferred layout of the 
browser is displayed using the layout DS 413 through 
416 and the reference to layout DS 412 in the browser 

DS. . , . 

[0060] If the corresponding application exists in the 
terminal, multimedia data is displayed using the same, 
or if it does not exist in the terminal, the con-esponding 
application is downloaded using the locator DS 410. 
[0061] in addition, the number of application(browser) 
included in the application DS is one or more than one^ 
, If the number of application is plural, an user-preferred 
application is employed using the weight DS 409 which 
is learned based on user preference for each applica- 
tion. ^ . „ 
[0062] Figure 5 is a view illustrating a description 
scheme of a browsing method or criterion in an user pro- 
file information data structure as shown in Figure 3 or 
Figure 4 according to a first embodiment of the present 
invention. 

[0063] The structure of Figure 5 is a function descnp- 
tion scheme structure for indexing and displaying a cor- 
responding multimedia data based on character/rela- 
tion, and includes a basic key item 501 and an order of 
key item 502. 



[0064] The basic key item describes browsing on the 
basis of character and relation 503 and 504. Figure 6 
illustrates an example of a browsing according to such 

a scheme structure. 
5 [0065] As shown in a video browser(user interlace) ot 

Figure 6. a character screen unit 602 of a character re- 
lational screen unit 601 displays characters, and a char- 
acter-relation screen unit 603 displays character-rela- 
tion satisfying a relation which is selected here. 
10 [0066] in addition, a main scene screen unit 604 dis- 
plays main scenes satisfying the corresponding relation 
in key frames 604a. Here, it is shown that a main screen 
unit 605 displays a selected particular scene in more de- 
tail 

15 [0067] Figure 7 is a view illustrating a description 
scheme of a browsing method or criterion in an user pro- 
file information data as shown in Figure 3 or Figure 4 
according to a second embodiment of the present in- 
vention. . 
20 [0068] The stnjcture of Figure 7 is a function descrip- 
tion scheme structure for. displaying a corresponding 
multimedia data using a 3-level tree in time sequential 
key frames, and includes a basic key item 701 and an 

order of key item 702. 
25 [0069] The basic key item describes browsing on the 

basis of key frames, and the order of key item 702 de- 
scribes time sequential browsing, and describes that the 
basic key item has a hierarchical structure{depth of key 

- -item,-level-l=3...) - - - - 

30 [0070] Figure 8 is a view illustrating an example of an 
interface of a browser using the function descnption 

scheme structure of Figure 7. ^ . , 

[0071] AS shown in a video browser(user interface) Of 

Figure 8, a key frame unit 601 displays multimedia con- 
35 tents in key frames in a time sequence, and a mam 
screen unit 802 displays a section which is selected here 
and is represented by key frames. 
[0072] According to the user profile information data 
structure and browsing method using the same of the 
40 present invention, while implementing content-based 
moving picture indexing and browsing, an user-pre- 
ferred browsing method(apprication) can be provided by 
each con-esponding multimedia data. 
[0073] Therefore, with respect to a multimedia data 
45 selected by the user, the user-preferred browser{appli- 
cation) can display the corresponding multimedia date. 
[0074] In addition, in the present invention, since the 
con-esponding multimedia data is indexed and browsed 
by a browser which is close or identical to the user-pre- 
50 terred browsing method(application). an user-fnendly 
and user-adaptive indexing and browsing environment 
can be provided when multimedia data is indexed and 
browsed based on contents. ^ „ 

[0075] As the present invention may be embodied m 
55 several forms without departing from the spirit or essen- 
tial characteristics thereof, it should also be understood 
that the above-described embodiments are not limited 
by any of the details of the foregoing description, unless 
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otherwise specified, but rather should be construed 
broadly within its spirit and scope as defined in the ap- 
pended claims, and therefore all changes and modifica- 
tions that fall within the meets and bounds of the claims, 
or equivalence of such meets and bounds are therefore 
intended to be embraced by the appended claims. 

Claims 

1. In a content-based multimedia data browsing, an 
user profile information data structure comprises an 
user-preferred application description scheme for 
browsing in an user profile in order to provide an 
user-preferred multimedia browsing method. 

2. The user profile information data structure of claim 

1 , wherein the user-preferred application descrip- 
tion scheme stored in the user profile is an applica- 
tion ID, or application locator. 

3. The user profile information data structure of claim 

2. wherein the application description scheme 
stored in the user profile further comprises a layout 
description scheme of applications 

4. The user profile information data structure of claim 
1 , wherein the number of user-preferred application 
description schemes stored in the user profile may 
be plural, and each of the applicatioin description 
schemes further comprises a weight for describing 
user preference. 

5. The user profile information data structure of claim 
1 or 4, wherein the user-prefen-ed application de- 
scription scheme stored in the user profile may be 
a plurality of application description schemes which 
are different from one another according to the type 
(genre) of a multimedia data object, and each of the 
plurality of application description schemes further 
comprises a weight describing user preference cor- 
responding to an user feedback. 
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15 



20 



25 



30 



35 



40 



ferred multimedia browsing method or brows- 
ing criterion for user-preferred browsing; and 
(c) multimedia data is browsed by analyzing the 
user-preferred application description scheme 
for user-preferred browsing in a corresponding 
user profile, if the user desires multimedia 
browsing. 

The method of claim 7, wherein the user-preferred 
multimedia data browsing method or browsing cri- 
terion are described differently according to the type 
or genre of multimedia data, and the multimedia da- 
ta is browsed according to the corresponding de- 
scription scheme indicating each user-prefen-ed 
browsing method or browsing criterion. 

9. The method of claim 7 or 8, wherein the user-pre- 
ferred multimedia browsing method or browsing cri- 
terion is represented as a character-oriented 
browsing, character/place relation-oriented brows- 
ing, time sequential and scene-oriented browsing, 
or combination thereof. 

10. The method of claim 8, wherein the number of 
browsing methods or browsing criteria described 
differently according to the type of multimedia data 
is at least more than one with respect to one type 
(genre) thereof, and weighted values can be added 
on^each of the browsing methods or browsing crite- 
ria, tmjs'arialyzirig the use^pfeferi^ed'applicatloh. 

The method of claim 7, wherein an application sat- 
isfying the user-prefen-ed browsing method or 
browsing criterion is executed the locator descrip- 
tion scheme of the .con^esponding application, in 
displaying the corresponding multimedia data. 

The method of claim 11 , wherein, if the proper ap- 
plication for browsing does not exist in the terminal, 
the corresponding application is downloaded using 
the locator description scheme 



11 



12. 



The user profile information data structure of claim 
5, wherein each of the user-prefen-ed application 45 
description schemes is structured hierarchically, 
and each part of the description schemes has a 
weight describing user preference. 

. In content-based multimedia data browsing, a mul- so 
timedia data browsing method, characterized in 
that: 

(a) multimedia data contains a contents de- 
scription scheme used in indexing/browsing 55 
multimedia data; 

(b) an user profile includes an user preference 
description scheme indicating an user-pre- 
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Functional ity 

501 -^<Basic Key Iten> 

,503 ^xKey^I-tero-l>--Char-acter- </Key^liem_.l> 

504 -.<lCey-Item 2>«'*Re[at ion between Keyltem r</Key-Item l> 

</Basic Key ItraP^ , 

502 — -<Order of Key ItQa> 

<Key-Item I^^^priority"* </Key-[terD 1> 
<Key-lteni a^-'priority" </Key-Ite!n 1> 
</Order of Key Itea> 
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Functionality 
<Ba6ic Key Iteffl> 

<Key -Item l>=''key-frame''</key-I:ea 1> 



</Basic Key Itrin> 
Order of Key Item> 

<Key-Item L>="tiine" </Key-Iteffl 1> 
</Order of Key Item> 
Oepth of key ItQD> 

<lcYel 1>="3" </level 1> 
</Depth of key Iteffl> 
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